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Abstract 

A moderate deviation principle for functionals, with at most quadratic growth, 
of moving average processes is established. The main assumptions on the moving 
average process are a Logarithmic Sobolev inequality for the driving random variables 
and the continuity, or weaker, of the spectral density of the moving average process. 
We also obtain the moderate deviations for the empirical spectral density, exhibiting 
an interesting new form of the rate function, i.e. with a correction term compared to 
the Gaussian rate functionnal. 
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1 Introduction 

Consider the moving average process 

+oo +oo 



X n : = aj-nCj = ajg, n+j , Vra G Z. (1.1) 



J=— OO j=— oo 



where the innovations (£ n )nez is a sequence of Revalued centered square integrable 
i.i.d.r.v., with common law £(£o) = Mi an d (a n ) n& z be a sequence of real numbers such 
that 

^|a n | 2 <+oo. (1.2) 
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This last condition (|1.2I) is necessary and sufficient for the a.s. convergence or convergence 
in law of the serie Ql.l|) . The sequence (X^) is strictly stationary having spectral density 

f{9) :=Var(£oM#)| 2 

where 

+00 

g(9) := a ne me . (1.3) 

n=— 00 

The moving average processes are of special importance in time series analysis and they 
arise in a wide variety of contexts. Applications to economics, engineering and physical 
sciences are very broad and a vast amount of literature is devoted to the study of the 
limit theorems for moving average processes under various conditions (e.g. Brockwell and 
Davis [I] and references therein). For example, the minimal condition for the central limit 
theorem for (X n ) is (see ^3 Corollary 5.2, p. 135]) that g is continuous at 6 = 0. The 
large deviations theorems have attracted much attention and many work, see Burton and 
Dehling [JJ, Jiang, Rao and Wang [IT], [IS], Djellout and Guillin [IT] and recently by Wu 
|21| on the linear case, under different assumptions on the law £o> an d the spectral density 
function of X, see Wu 1211 . for relevant reference and more details. 



The main purpose of this paper consists to investigate the Moderate Deviation Principle 
(in short MDP) for the so-called empirical periodogram of order n of the process {X^) 
defined by 



l n (9) := - 
n 



^X k e ike 



k=l 



(1.4) 



which are random elements in the space L p (Y,d6) of p-integrable function on the torus T 
identified with [— it, tt[ equipped with the weak convergence topology. We present a simple 
proof under some conditions such as the L q (T, <i#)-boundedness of the spectral density of 
(Xk) and a Logarithmic Sobolev Inequality (in short LSI) for /x. 

The quantity (|1.4j) is one of the main tools in the study of nonparametric statistical 
estimation of the unknown spectral density / on the basis of the sample (X\, ■ ■ ■ ,X n ) 
from the process (X n ). There exists an abundant literature on several properties and limit 
theorems of Q1.4JI . specially in Gaussian case. The central limit theorem was generalised by 
L. Giraitis and D. Surgailis ( 15 j) to non Gaussian case and they proved that ^Jn{l n {K) — 
KZ n (h)) converge in law to normal distribution A^(0, a 2 ). In Gaussian case this result was 
already proved by Avram pQ and Fox and Taqqu |14j . 

We also establish the MDP for additive non-linear functionals of the moving average 
processes : 

1 n 

-J2 F (X k ,-,X k+ i) (1.5) 



n 

k=l 



where F takes its value in R m , under some regularity for the derivatives of F. This 
regularity enables us in particular to obtain the MDP for 

F(Xk, Xk+i) = (XkXl, XkX^ +1 , XkXl +l ) 

which is of particular interest in statistics. 

To our knowledge, it is the first time a MDP for functionals of moving average is estab- 
lished, for a general class of measurable functions F (and not only in the Gaussian case). 
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Bryc and Dembo have considered quadratic functional of Gaussian processes both at 
the level of large and moderate deviations. We extend their results for the MDP as our 
r.v. are not necessarily Gaussian (under the same hypothesis on the density), and we 
consider the autocorrelation vector (in a non i.i.d. setting). Moreover, and compare with 
Bercu and al |2J, we also establish the MDP for the empirical spectral density, not only 
for marginals of the empirical spectral measures. We exhibit an interesting new form of 
the rate function, i.e. with a correction term compared to the Gaussian rate functional. 

Recall that any real stationary Gaussian process (X n ) with a square integrable spectral 
density function / can be represented as so that one may see our results as the 

moderate deviations alternative to the seminal work of Donsker and Varadhan ^Hj on 
large deviations of Gaussian processes. 

This paper is structured as follows. The MDP for the empirical spectral density is stated 
in next section. The MDP for non-linear functionals is given is section 3. We establish 
the key a priori estimation in section 4. The last section is devoted to the proofs of the 
main results. 



2 MDP for the empirical spectral density 

In this section we only consider, without loss of generality, and to simplify notations, 
the real case. Let (£ n )nez is a sequence of R- valued centered i.i.d. r.v., with common law 
£(£o) = A*; and let a := (a n ) n& i be a sequence of real, and define (X n ) by 1)1. lj) . We will 
always assume that [i satisfies a LSI, i.e. there exists C > such that 

Ent M (/i 2 ) < 2CE M (\Vh\ 2 ) (2.1) 

for every smooth h such that E A1 (/i 2 log + h 2 ) < oo, where 

Ent M ( h 2 ) = E M (h 2 log h 2 )-E^(h 2 ) log R^h 2 ). 

See Ledoux for further details on LSI. Note that it implies in particular that there 
exists some positive 5 such that 

E M (VW 2 ) < oo. (2.2) 

Let (b n ) a sequence of real number such that 

1 < b n < ^/n. (2.3) 
For any measure A on the torus T (identified with [— 7r, tt[, in the usual way), let 

L p (T,d\) := j/i measurable : \ \h\\ p = (^J |/i(A)| p dA^ < ooj , 1 < p < oo, 

and 

L°°(T, dX) := <h measurable : ||/i||oo = esssup AgT |/i(A)| < oo 
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We are interested in the MDP of the empirical spectral density of (X n ) defined by 

2 



l n (9) := - 
n 



k=l 



which are random elements in the space L P (T, d9) equipped with the weak convergence 
topology. 

We first present here the MDP for the empirical autocorrelation vector which will be our 
main tool for the MDP of the empirical spectral density, and has its own interest for 
E(£ 4 ) - 3E(£ 2 ) 2 



statistics. Let K4 



2\2 



Theorem 2.1. Suppose that [i satisfies the LSI that (a n ) n £z satisfies Ql.fy) . Suppose 

moreover that the spectral density function f is in L q (T,d6), where 2 < q < +00 and 

-^n 1 /? _> 0, then ( ^ (X k X k+e - EX k X k+e ) J satisfies the MDP on M. m+1 

\ nV k=l J 0<i<m 

with speed and with the rate function given by 

I(z)= sup {(A,z)-^A*S 2 a); 

where T? = (S^) <fc,£< m and 

^ = h I ( ei{k ~ m + Sk+t)e ) f2{6)de + KA (h L w)'** 60 ) (h St meieedd ) ■ 

Remark 2.1. The additional assumption on the normalizer b n is exactly the one sup- 
posed in Bryc-Dembo [SJ Th. 2.3], but they only consider the case / = m = in the 
Gaussian setting. Their large deviations result (namely Prop. 2.5 in 6 ) for the empirical 
autocorrelation is moreover restricted to the i.i.d. case. 

Remark 2.2. First note that there exists some practical criteria ensuring the fact that 
a measure \i satisfies some LSI. For example, consider a C 2 function W on M. d such that 
e~ w is integrable with respect to Lebesgue measure and let 

dfi(x) = Z- X e~ w ^dx (2.4) 

and suppose that for some c in M, W"[x) > eld for every x and that for some e > 0, 

e (c-+z)\x-y\ 2 d(i(x)d(Ji(y) < 00 (2.5) 



where c~ = — min(c, 0). Then \x satisfies (j2.1|) by the criterion of Wang [TJJ|. Obviously 
Gaussian variables fulfill this criterion. See Bobkov-Gotze jS] for a necessary and suffient 
condition in the real case, relying on Hardy's inequalities. 

The following corollary follows from Theorem 2.1 
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Corollary 2.2. Under the assumptions of Theorem 2.1, we have for all i > 0, 

l~ (XkXk+i — EXkXk+i) satisfies the MDP on E with speed b 2 n and rate function 

\ V n n k=1 J 



given by 

1 7 2 

iHz) 



2 h /t(1 + cos(2/0))/2(0)d0 + k 4 / T cos(^)d0) 



2 ' 



Remark 2.3. Now assume that (£ n ) is a sequence of real i.i.d. normal random variables, 
so (X n ) is a stationary Gaussian process and inversely any real Gaussian stationary process 
(X n ) with a square integrable spectral density function / can be represented as (jl.ljl . 
In this case, we have E(£ 4 ) = 3E(£ 2 ) 2 and thus K4 = 0, so we obtain 



1 7 2 



I{Z) 2i/ T (l + C os^))/2(^)d^ 

Let us present now the main result of this paper. From Theorem 2.1 (and its proof) 
together with the projective limit method, we yield the functional type's MDP below, for 



£n(0) = ^ (ln(0) ~ ET n (0)) . 

Theorem 2.3. Suppose that fi satisfies the LSI \2.1\) . that (a n ) ng ^ satisfies il.2\) . Sup- 
pose moreover that the spectral density function f £ L q (T,d9), where 2 < q < +00 and 
JfenVi+W 0. Let | + ^ = 1 and ± + J < \, then (C n ) n > satisfies the MDP on 

(L p (T,d9),a(L p (T,d9), L p (T,d8))) with speed b\ with the rate function given for all even 
t? e L p (T,d9) by 



d,6 



2tt J t 4/ 2 (6l) 2 + k a \2ir J t 2f{6) 



V(0) 



dS 



if r](8)d0 is absolutely continuous w.r.t. f(9)d9 and 



V(0) 

fio) 



6 L 2 (T,d9); 



+ 00, 



otherwise. 



Remark 2.4. Now assume (X n ) is a stationary Gaussian process, so we obtain that 
(£ n )n>o satisfies the MDP on L P (T, dO) with speed b\ with the rate function given by 



I( V ) 



1 

2^ 



r?{0) 
4/2(0) 



cie 



if rj(9)d9 is absolutely continuous w.r.t. f{6)d9 and G L (T, d#); 



otherwise. 



I +00, 

We thus give the MDP for the spectral empirical measure in the setting of Bercu and 
al 0, note however that they only consider the marginal LDP, i.e. LDP for I n {h) for 
some bounded h on the torus with an extra assumption on the eigenvalues of the Toeplitz 

' r l n (9)h(9)d9. 



matrix, where T n {h) 



2vr 
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Remark 2.5. Notice that the extra term with respect to the Gaussian case in the eval- 
uation of the rate function was also found by L. Giraitis and D. Surgailis (^Hj) i n their 
investigations of the CLT for 2 n (h). The result of (|15|) can be summarized as below : if 

lim - tr ({T n (f)T n (h)f) = -L / f 2 {6)h 2 {e)d9- (2.6) 
n— >oo n 2ir Jf 

(where T n (h) is the Toeplitz matrix of /i)then y / n(X n (/i) — EZ„(/i)) converges in law 

(as n -> oo) to the normal distribution jV(0, a 2 ) with cr 2 := — / (f(0)h(6)) 2 d6 + 

27T J T 

«4 I — / f(9)h{6)d0 I . In Gaussian case this result was already proved by Avram 
and Fox and Taqqu [Tl] . 

Remark 2.6. Our main tool in the proof of our Theorem 2.3 is (|2.6[) . which is valid under 
our conditions on / and /i. It seems that the single condition that the integral on the right 
hand side of JUJ) is finite (i.e. h £ L 2 (YJ 2 dO)) is not sufficient to obtain ((2TH|) . This 
explains why we cannot obtain the MDP of the empirical spectral density in L 2 (T, f 2 d0). 

Remark 2.7. One can not hope that the MDP in Theorem 2.3 holds w.r.t. the strong 
topology of L p (T,d8), because the rate function I(rj) is not inf-compact w.r.t. this topol- 
ogy 

As a consequence of Theorem 2.3 we have the following 

Corollary 2.4. Under the assumptions of Theorem 2.3, we have that for all h £ L p ' (T, d6) 

lim sup log ( e b ^ ^ h (d)c n (e)de\ = I ( A f h \0)f^ de + K JJ_ f h(9)f(6)de) J. 
n-oo K \ J 2 \ 2-k J T \2tt J t J J 

In the next corollary of Theorem 2.3, we replace EZ n (#) by f(8), more useful in practice. 

Corollary 2.5. Under the assumptions of Theorem 2.3, assume moreover that f G 
L 2 (T, d6). The same conclusion holds for C n instead of C n where 



c n {6) = y^(i n (e)-f(e)). 

Remark 2.8. By looking carefully at the proof of this corollary, one may see that the 
needed convergence of ET n (/i) to J fh is ensured by our assumption on /' wich is surely 
too strong (as the negligibility of this term is in X, ) but remains practical, solely relying 
on the spectral density. Other possibilities impose implicit, and thus difficult to check, 
conditions linking h and /. 

3 MDP for non-linear functionals 

Let us present now the following sligthly more general model: {t, n )n& is a sequence of Re- 
valued centered i.i.d.r.v., with common law £(£q) = fJ,, and let a := (a n ) ne z be a sequence 
of real p x d-matrix. We now present the MDP for a functional F : (R p )' +1 — * R m , i.e. 
the MDP of 

1 n 

S n (F) = — — V (F(X k , X k+l ) - E (F(X k , ...,X k+l ))) , 



6 



and we use the notation F(xq, ...,xi), so that d Xi F should be understood as usual. Let 
f(9) = g(d)T(^)g*(d), Tfa) := (cov(&$) itj=1 ...J. 

Theorem 3.1. Suppose that fj, satisfies the LSI 12.1]) . that (a n ) n& z satisfies 11.2]) and g 
is continuous on T. Suppose moreover that d Xi F is Lipschitz for i = 0, then S n (F) 
satisfies the MDP with speed b\ and good rate function If given by 

If(z) = sup \{X,z) - -X*T, F x\ = l-z*T, F 2 z. 
AeR m I 1 J 1 

where S^ 2 is the generalized inverse of the covariance matrix T, F given by 

Y? F := lim -T[y2F(X k ,...,X k+l )) (3.1) 
n->+oo n \ ^-^ J 

\k=l / 

which exists. 

Remark 3.1. Note also that under our assumption on F it enables us to obtain the MDP 
for 

F(Xk, ...,Xk+i) = {XkXl, XkX^ +1 , XkX k+l ) 

as the derivatives in each coordinate is Lipschitz, without further assumption on the 
normalizer b n but with a bounded spectral density. 

Note also the following corollary in the linear case F(xq, .., x{) = xq which weakens the 
assumptions on g. 

Corollary 3.2. Suppose that \x satisfies the integrability condition \2.2]) . that (a n ) ne z 
satisfies hi. 2]) and g is continuous on a neighborhood of 0, then S n {F) satisfies a MDP 

with speed b 2 n and rate I(z) = sup {(z, A) — -A*/(0)A}. 



It generalizes Th. 3.1 of Djellout and Guillin to the case of unbounded r.v. Under 
assumption (|2.2[) . the crucial inequality ()5.3|) . as a consequence of the LSI, may not be 
used. However, we may encompass this difficulty by noting that integrability 1)2. 2|) is, by 
Djellout and al. |12l Th. 2.3], equivalent to a Transport inequality in Li-Wasserstein 
distance which is itself equivalent to the inequality ()5.3|) with the Lipschitz norm instead 
of the gradient in the right hand side, but for this particular linear case, the gradient and 
Lipschitz norm are equal so that the same proof works. The release of the assumptions of 
the continuity of g comes from the fact that in this case, Lemma 4.3 is not used. 



4 A priori estimation 

We recall the following well known elementary result 

Lemma 4.1. Suppose Y = \Y±,- ■ -,in]* is a real valued centered Gaussian vector with 
covariance matrix R and let A be a symmetric real valued nxn-matrix. Then with X\, X n 
the eigenvalues of the matrix AR 



logEexp(z(y,^y)) 



1 71 

-Jjlog(l-22A i ) if zmaxXj<l/2 

2 ^ l<J<n ( 4 ;Q 



+ oo, otherwise. 
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We give a crucial lemma which was first stated in Wu and reproduced here for 

completeness. 

Lemma 4.2. If the centered r.v. £o satisfies \2. 6 J\) . then there is some constant K > 
such that 

L(y) :=Eexp({Co,y)) < exp ( ^-\y\ 2 ) , Vy € M d . 



x 2 

Proof : By Chebychev's inequality, 

fc| > *) < exp(-t 2 <5)Eexp(<5|£ | 2 ) := C(5) exp(-t 2 5), Vt > 0, 



consequently 



L(y)<Eexp(|£ ||y|) = l + / 

Jo 



oo 



yle^PdCol > t)dt 



POO 

< 1 + C(8)\y\ / exp(%| - t 2 5)dt 
Jo 

/oo 
exp(t|y| - t 2 8)dt 
-oo 

Thus there is C\ > such that (2.1) holds for all \y\ > 1. 

For |y| < 1, notice that logL(y) G C°°(lR d ), and logL(O) = 0, V log L(y)\ y=0 = E£ = 0. 
By Taylor's formula of order 2, we have for all y with |y| < 1, 

\ogL{y) < l -C 2 \y\\ 

( d 

where C 2 := sup V [fy fy, logL(y)] 2 . Thus (2.1) follows with K := d V C 2 . 

We extend (|4.1j) from Gaussian distribution to general law /x satisfying (|2.2j) . which is a 
slight generalization of the preceding lemma. 

Lemma 4.3. Let X = [X±,--- ,X n ]' G (M p ) n mi/i covariance matrix A = (^4fc i z)i<fc,/<n 
where A^i is a p x p matrix given by 



Ak,i :=nX k Xl) = ±- f e^ k -Wg(8)g(8yd8. 
2ir J T 



Let B be a symmetric real valued pn x pn-matrix. Assume \2.2\i . Let K > given in 
lemma 4-2 .Then with ^j" 1 , • • -,/Jpn the eigenvalues of the matrix yBAyB 



logEexp(X{X,BX)) < < 



1 pn 1 



+ oo, otherwise. 



2K 2 
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Proof : The main difficulty resides in the nonlinear property of < x,Bx >. The trick 
consists to reduce it to an estimation of linear type in the following way : 



E jexp 



-t 2 <X,BX > 



E < exp 



BX 



E < exp 



t{VBX,Y)]\-y{dY) 



where 7 is the standard Gaussian law N(0, 1) on 
Since 



(VBX,Y) = (X,VBY) = J2(X k ,(^/BY) k ) = ^,5>*_ fc (^)*>- 

jez k=i 



k=l 



where (a* k ) is the hermitian transposition of the matrix (a^fc), we get by Lemma 4.2. and 



the i.i.d. property of 

jexp t(VBX,Y) } < exp 



E- 



KH 



i+i 



k=l 



Now observe that 



E 



J2a*_ k (VBY) h 



k=i 



J2( a U(^ Y )^ a j-i(^ Y )i) 

k,l=l j&L 
n 

((VBY^J^dj-kaU^Yh) 
k,l=i j& 

n 

Y J {{^By)k,A Kl {VBY) l ) 

k,l=l 

(y, VbaVby) 



Then letting • • be the eigenvalues of the matrix \JBA\/B (which are also the 

cs 

I 



eigenvalues of AB), we get for all A such that t 2 K 2 max fi^ n < 1 



E jexp 



-t 2 <X,BX> 



< 



{exp -K 2 t 2 (Y,^/BAVBY) \ 

)« I L 2 J J 

i£iog(i-^ 



j(dY) 



and it follows with A = t 2 /2. 

Remark 4.1. If we assume \\g\\oo = lllff(^)lllL oo (M,dfl)j an d B = I we obtain exactly the 
result in Wu [21]. In fact in this case, we have for any A > such that 2A-fT 2 ||g||^ < 1, 



logE e W)<-ilog(l-2A^|| 5 ||L) np . 



(4.2) 



Remark 4.2. Instead of lemma 4-2., we can use the consequence of the LSI \5.3\) to prove 
Lemma 4-3., but \5.^) is more stronger than \2.2\) (see below). 
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5 Proofs 

Introduce first the following coefficients for each N G N* : a x = Uj ^1 — ^j^j if lil — 
N and otherwise, and define the Fejer approximation of X k and g 

jez jez 

that will enable us to first consider the finite case and then extend it to the infinite case by 
approximation. Remark that if / G L (? (T, d9), q > 2, then fj(g — g N ) i d9 — > as N — > oo. 
For any real and symmetric function h G L (T, cZ^) , let T n (h) be the Toeplitz matrix of n 
associated with h i.e. T n (h) = (fk-i(h))i<k,i< n where fk(h) is the fcth Fourier coefficient 
of h 

f k (h) = — [ e ik6 h(6)d9, \fk G Z. 

The matrix T n (h) is obviously real and symmetric, is positive definite whenever h > 0. 

I Ac I 

For an n x n matrix A, we consider the usual operator norm ||j4|| = sup — — — . 

x£M. n p| 

We shall need the two following lemmas. The first gives an estimate for the maximal 
eigenvalue of the covariance matrices T n (f) which is Lemma 4.7 of Bryc-Dembo 0. The 
second one concerning the asypmtotic behavior of the trace of the products of Toeplitz 
matrices see (E 



Lemma 5.1. // 1 < q < oo then for all n > 1 we have ||T n (/)|| < n l / q \ |/| \ q . 

Lemma 5.2. Let f k G L 1 (T, d6) n L^(T,d9) with < q k < oo for k = 1, •■• s and 
s 1 

> — < 1. The following assertion hold 

(flTn(f k ))=ro(flfX 



n— >oo ?T, 



\fc=l / \fc=l 



5.1 Proof of Theorem 2.1 

We shall prove it only in the real valued case. The proof is divided into three steps. In the 
first one, we prove that the MDP holds for some suitable approximation of our process, 
then we will show this approximation is a good one in the sense of the moderate deviations 
and we will finally establish the convergence of the rate function and the subsequent 
existence of the limiting variance. 

Step 1. Let 

1 n 

Qn = 7=7 { x k x k+i - ^ x k x k+ii) ■ 
Vn0n k =i 

The crucial remark is that the sequence X k X k+l is a 2A^-dependent identically distributed 
sequence. Using (|2.2|) . we get for all N and for some positive n that E (e^ Xk x k+i\ J < oo. 
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We may then apply results of Chen [S] on Banach valued MDP of m— dependent sequence, 
enabling us to get that for each ./V fixed, for all A 



\fc = l / 

:= y X% e M, (5.1) 
= ^ £ C«r{X»xr,X?X&) 

k=-N 

{ A 2 

and that satisfies the MDP with the good rate function I N (x) = sup < Xx — —^"n 

agk I 2 

S*tep S. The purpose of this step will be to prove the asymptotic negligibility as N — > oo 
of Q n - Q% with respect to the MDP, i.e. we will establish that for all A 6 M 

lim limsup -=■ logE ( e A6 " (Q "- Q ™ ^ = 0. (5.2) 

Remark that, by Jensen inequality and as our functionals are centered, we only have to 
establish the upper inequality in (|5.2|) . 

Our main tool is the following consequence of the LSI (|2.1|) . see Ledoux |191 Th. 2.7] 
applied to our context (after having extended (|2,lj) by tensorization to the infinite product 
measure of /z): for exponentially integrable G, 

E (e A v*< G - EG )) <E(e?$°Na\*Y (5.3) 

with C given in H2.ll) . Let apply it to 



k=l 



so that our main estimations are now transferred to the gradient of G. 
Clearly 

n 

%C = ^(a-i-kXk+i + Oi-k-iXk - af_ k X^ +l - afL k _ t X^); 



so 



k=l 



\VG\ 2 < 4^ - af_ k )X k+l f + ~ «£*-,)X*) S 

ieZ \ k=l k=l 

n n \ 

fe=i fc=i / 

= (/) + (//) + (HI) + (IV). 
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By Holder inequality, 

logE (e X ^ (G - EG) ^) < logE ( e ^4llVG||^ 



+ ilogE (V^ 2 #('")) + I logE (e 4CA 4(^) N 



Let us deal with the first term of this inequality. We rewrite the expression of (I) as 

n 

( J ) = 4 Y1 12 ( ai - k ~ a ?-k)( a i-k> ~ af_ k ,)X k+l X k , + i 

iGZ k,k'=l 
n 

= 4 h'- k ((g - g N ) 2 )x k+l x k , +l 
k,k'=i 

= 4 < X. +l ,T n ((g - g N ) 2 )X. +l > 
Let Hi' N , ■ ■ -,^n ,N be the eigenvalues of the matrix 

y/T n ((g-g")*)T n (f)y/T n ((g-gNn 
Its operator norm is bounded from above by (using Lemma 5.1) 



|T n (/)|| • \\T n ((g - g N ) 2 )\\ < n^\\f\\ q n^\\{g " 9 



N\2u 
\\q- 



n l<j<n' 3 



Since ^ nl ^ q — * and / G L q (T, d6), we choose n sufficiently large such that 32C 2 A 2 -^ max < 
1. Applying Lemma 4.3, we get 

h 2 



logE(e 4CA2 ^«) < -- X>g(l " 32CK 2 A 2 %^). (5.5) 
Similarly, we have 

logE(e 4CA 4(^)) = logEe i6C#A 2 <^T„((0- 9 ") 2 )*-> 

i n /i 2 (5 6) 

< _i^l og (l _ 32C^ 2 A 2 %"' JV ). 

j'=i 



2 ^ ov ' n 
Let us deal with the third term. We rewrite the expression of {III) as 



(///) = 4]T £ a^a^,(^-^)(^-^) 

iGZ fc,fc'=l 
n 

= 4 £ r fc ,_ fc ((^) 2 )(X fe+z -Xi v +i )(X fe , + ,-^ +i ) 
fc,fc'=i 

= 4 < X+, - X.^, T n ((g N ) 2 )(X. +l - X N +l ) > . 
12 



Let v™' N , ■ ■ •, Un' the eigenvalues of the matrix 

^T n ((g") 2 )T n ((g - g N ) 2 )^T n ((g") 2 ). 
Its operator norm is bounded from above by (using Lemma 5.1) 

ll^((^) 2 )ll • ll^((^ - ^) 2 )ll < ^/^IK^) 2 !!^ 1 /^!!^ - ^) 2 || Q . 

By our assumptions on b n and /, once again we take n sufficiently large such that 



b 2 

32CK 2 \ 2 — max i/ 1 ' < 1. Applying lemma 4.3., we get 

n l<j<n ■> 



logE(e 4C,A2 ^ m )) < -I^log(l-32CK 2 A 2 %;- JV ). (5.7) 

3=1 H 

Similarly 

logE( e 4CA 4(^)) < _1 £l og (l - Z2CK 2 \ 2 %f N ). 

3=1 

By ()5.4|) and the previous estimations Q5.5JI (|5.6() H5.7|) (|5.8|) . we have 



(5.8) 



llogE(e A& «(^-^)) < (Ml " 32CK 2 A ; 

n 7=1 ^ 



,o-..^v , _ , - \ 2 ^f)+lo g (l-32CK 2 A^,f) 

o„ V / 4 n ^— f \ n J 

(5-9) 

Notice that by the Taylor's expansion of order 1, we have for \z\ < 1 



log(l-z) = -z{l-tz)- 1 



where t = t(z) G [0,1]. This applied here to zJ' N = 32CK 2 X 2 ^ \]> N , [X] 
\™ ,N = $' N ) which satisfies s 

uniformly in 1 < j < n. Thus 



>n,JV n.N 

j j or 

A™' = /i™' ) which satisfies sup \z™' | — > as n — ► oo, and hence |1 — £(-2™' )z™' | — ► 1 

l<j<n 



lim ±logE(e x %(Qn-Q»)) < i 6C 2 A 2 Hm [ ly^n,N + n, N) \ 

n— >oo 0„ V / n— >oc I 77 z — ' J ■> j 

Thanks to the elementary formula tr (AC) = tr (CA) and using Lemma 5.2, we have 

1 n 1 

lim - ^2 = Hm - tr (T n (/)T n (( 5 - ^) 2 )) = f (( 5 - /?/) . 
n— >cxd fi, * — » j n^oo 77 

3=1 

Similarly 

1 n 1 

lim l£^ = ite (T n ((^) 2 )T n (( 5 -^) 2 )) =f ((^) 2 ( 5 -^) 4 ). 

n^oo 77, ' — » J n^oo 77, 



So we have 



limsup^logE(e A ^ Q "- Q ^) < 32C 2 A 2 f (/Vo((<? - g N ) 4 ). 

n— >oo 0„ \ / 
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Letting iV to infinity , we get the desired negligibility (|5.2|) . 

We then obtain that Q n satisfies the MDP of speed b 2 n and good rate function / by the 
approximation lemma |211 Th. 2.1], with / given by 

I(x) = supliminf inf I N = suplimsup inf I N . (5.10) 

5>0 N^oo B(x,S) 5 >0 AT^oo B(x,6) 

Step 3. We have now to prove the identification of the rate function. First, we show that 
T, 2 := lim -E\y^(X k X k+ i-EX k X k+ i)\ exists and £ 2 = lim EisR. (5.11) 

n-+oo n \ Z — ' / iV— >+oo 

\k=l / 

By the previous estimations, we have that for all |A| small enough 

E ( e MG-VG^ < 1 + l6C 2 X 2 n f (f 2 )f ((g - g N )*) + o (£) 

/ \ A 2 A 2 

Since, for all |A| small enough E ( e HG~EG) j = i -|_ E (G — EG) 2 + o(— ), 



2 

/A 2 

we deduce that E (G - EG) 2 < 16C 2 nf (f 2 )f ((g - g N ) A ) + o I — 
So we have 

sup -E (G - EG) 2 — ► as N -» +oo . 

n n 

Whence the limit S 2 in (|XT|) exists, and Y, 2 N — * S 2 . 
Now we claim that 

1 A 2 
lim -logEexp (A6 2 Q„) = — S 2 . (5.12) 

For fixed p, q > 1 with = + A = 1, by the Holder inequality we have that 

logEexp (A6 2 Q„) < -^logEexp (q\b 2 n {Q n - Q%)) + ^logEexp {pb 2 n \Q%) 
for all A. From (|5.1|) and previous estimations it follows that for some constant B > 

hmsupllogE(>« A ^) < ^Y? N + q B\ 2 rv{(g-g N ) A ). 

Letting N — > oo and using Q5.11JI . we get 

lim sup log E (e b ' AQ ") < ^S 2 . (5.13) 
Similarly, by the Holder inequality, we have 

logEexp (6 2 AQ^) < - logEexp (^\{Q% - Q n )] + - logEexp (6 2 AQ„) 
q \ p J P 

for every A. From 1)5. lj) and previous estimations it follows that 
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— < liminf 4t logE ( e b « XQ A + ^Bf ((g - g N f) 



2p 2 JV - rwoc pbl b V ; 2p 2 

Letting N — > oo and using (|5.11|) . we obtain 



— £ 2 < liminf log E (e b " XQn ). (5.14) 
Letting p -> 1 in (joTS)) and lf5~H)) yields (|5TT2^I . 

So by ()5.12j) and the Laplace principle ^3 Th. 2.1.10, p. 43], we have 

lim ^logE/V'^ = — E 2 
bl s V J 2 



= sup {xy — (5.15) 
To conclude, we have now to show that I(x) defined in (|5.10|) is convex. 

I ( -(x\ + x 2 )) =suplimsup inf I N 

V 2 / <5>0 TV^oo B(±(xi+x 2 ),6) 

inf I N < inf I N (-{yi+V2 

B(±{xi+x 2 ),5) y 1 eB(x 1 ,S),y 2 EB(x 2 ,8) \2 

< \ mf (I N ( Vl ) + I N (y 2 )) 

2y 1 <=B(x 1 ,6),y 2 <=B(x 2 ,5) K " 

= l( mi I N + inf I N 

2 \B(xi,S) B(x 2 ,S) 

So lim sup inf I N < — (lim sup inf I N + lim sup inf I N 

N^oo B(\{x 1 +x 2 ),&) 2 \ AT^oo B(xi,5) N^oo B(x 2 ,S) 

Letting 8 j 0, we get I {\{x! + x 2 )) < \ (f{xi) + I(x 2 )\ ■ 

Since / is inf-compact and convex, by Fenchel's theorem and (|5.15|) . we get for all x G 

A 2 

I(x) = sup{Xx - y £ 2 }, 



which is exactly the announced rate function. 



5.2 Proof of Theorem 2.3 



We begin with the following lemma |20[ Chap. 2, Prop. 2.5] which implies the exponential 
tightness. 

Lemma 5.3. Under the hypothesis Theorem 2.3, we have that for all h G L p ' (T,dd) 

limsupllog ( e bl±hmc n (e)de\ < +QO 

n— >oo O n V / 

In particular P(£ n G •) is exponentially *-tight in (L P (T, d6), a{L p (T, dO), L P '(T, d0))), 
where ^ + ~ = 1. 
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Proof : For every function h £ L p '(T,d9), the function h(9) = \[h{9) + h{—9)} is even 
and 

±- f h(9)l n (9)d9 = f h(9)l n (9)d9, 
we shall hence restrict oureselves to the case where h is even. Since 

±- ! h(9)£ n (9)d9 = -^((X.,T n (h)X.) - E(X.,T n (h)X.)) 
Let apply Q to ff((6)j 6 z) = (X,r„(/i)X) : 

E(e A #(£/TM0)£„W) = E(e A v* (H " EH) ) < E(e x2 ^ c ^ H \ 2 ). 

Clearly 



ivfi 2 = E(%^) 2 = 2 E wo 

iez «ez \ z,fc=i 



2 

\ 

kJ 



n 

= 4 T n {f)^iXiXiiT n (h)k,iT n {h)k',v 

l,k,l',k'=l 

= 4(X.,T n (h)T n (f)T n (h)X.). 
Let a", • • -, the eigenvalues of the matrix 

VT n (/ l )T„(/)T n (/ l )r n (/) v /r n (/ l )r n (/)r n (/ l ). 

Its operator norm is bounded from above by (using Lemma 5.1) 

||T B (/)|| • \\T n (h)T n {f)T n (h)\\ < {n^\\f\\ q f{n7\\h\^f 

Since h^l^lv' — > 0, / G L q (T,d9) and h £ L P '(T, d6>), we take n large enough such 
b 2 

that 8CftT 2 A 2 — max a" < 1. Applying Lemma 4.3. we get 

n l<j<n J 

logE^^A mc»W) < -if>g (l - 8C^ 2 A 2 ^a?) . 

Thus 



2^ °\ n 



limsup^log(e^^ £ ^ <8C 2 A 2 lim T a " 
Since / € L 9 (T, d#) and /i G L P '(T, with ^ + | < |, applying Lemma 5.2, we obtain 

lim -Y>i = lim - tr (i T n(f)Tn(h)) 2 ) = Mfh 2 ) < +0O. 

The proof of the Lemma ends. 

We may now turn to the proof of Theorem 2.3. 
Proof : 
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( 1 \ 

Step 1. Since - — — (X k X k+ £ — KX^X^ij is negligible with respect to 

\ k=n-£+l / <£<m 

the MDP, using Theorem 2.1, we get the finite dimensional MDP on M m+1 of 

7 — 7= {XkX k+ £ — EX k X k+e ) 



0<£<m 



with the rate function given by 

/(*)= sup {{\,z)-±\*Z 2 \} . 



Now notice that 



— / e lK C n {d9) — - — -= S~) (X k X k+f — EX k X k+ e). 
■ft jt o n y/n * 



Thus (£ n (Z))o<e<m satisfies the MDP on M m+1 with the same rate function. By Lemma 
4.3 and the projective limit Theorem [fJJ Th. 4.6.9], we deduce that (£ n ) n >o satisfies 
the MDP on (L P (T, d6), a(L p (T, d9), L P '(T, d0))) with the rate function given by for even 
function r] G W(J,d0) 

I( V ) = sup sup { / f E e ik6 X k ) V (9)d9 - U ( £ e lke X k ) 1 (5.16) 



where 



k=0 



\k=0 

m 



+ 



Step 2. Identification of the rate function. Remark as trigonometric polynomials are dense 
in L 2 (T, f 2 d9) , one can find for h G L 2 (T, f 2 d9), an approximation by some trigonometric 
polynomials sequence h n , such that 



lim / (hn-h) (9)f 2 (9)d9 = 0. (5.17) 
n -*°° Jt 

So we can extend continuously the definition of A to all function h G L 2 (T, f 2 d9) 



Hh) = ^J h 2 (9)f 2 (9)d9 + « 4 Q- h(9)f(9)d9 

(a) Suppose that n(9)d9 is absolutely continuous w.r.t. f 2 (9)d9, and — G L 2 (T,d9). Let 

h n the sequence defined below in (|5.17|) . by Cauchy- Schwartz inequality, we get for all 
even function r/ G L P (T, d9) 
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Win-hmiimw) < [ \h n (9)-h(e)\ 2 f 2 (e)de [ (A {e)do — o. 



n^oo 



So J(r/) defined in (|5.16|) coincides with 



So 



implies that 



i(n) = sup (-L / h(e) v (e)de - ±A(h)\ ■.= sup £>(/*). 

h£L 2 (T,p<W) I Z7r ^ J heL 2 (J,pd8) 

Let us find explicitly the maximizer /io of D(h). Let G ^ 2 (T, f 2 d9) and e > 0, 

+2KA {h j T f{ - 6)mde ) j T f{9)k{9)de 

^ D(h + ek)-D(h) =Q; v ^ ex2(T)/2 ^ (518) 

77(e) = 2/(0) 2 / l (#) + K J±-^ f(O)h(0)d6\ f(9). (5.19) 
Dividing (|5.19|) by / and integrating over T , we obtain 

Replacing this last expression in (|5.19|) . it is then easy to verify that the only functional 
ho G L 2 (T, f 2 d0) realizing (|5~TH)) is given by 

Calculating D(ho) gives finally the announced rate function. 

(b) Now we have to treat the case where rj(0)d9 is absolutely continuous w.r.t. f 2 (9)d6 
but ^ L 2 (T,d6>). So there exists g G L 2 (T,d9) such that / g{9)^-{9)d9 = +00, and 

gj > 0. Let h := j, so h £ L 2 (T,f 2 d9), we choose h n = (hV (-n)) A n. We get by 
dominated convergence 



lim / (h n (9)-h(9)Yf(9) 2 d9 = 0, 

so it follows that 



n— >+oo 



lim A(/i n ) = A{h). 

Ti " ' ~ 

By Fatou's lemma we get 



liminf / h n (9)r l (9)d9 > [ liminf h n (9)r]{9)d0 = +00. 

n— >oo j-jp n— +00 
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Since 



i(ri)>^^h n (e)ri(e)de-±A(h n ), 



letting n to oo, we obtain I{rj) = oo. 

(c) Now we have to treat the case where r](9)d9 is not absolutely continuous w.r.t. f 2 (9)d9, 

i.e. there exists a set K C T such that / f 2 (9)d9 = while / r](9)d9 > 0. For any t > 0, 

Jk Jk 
we approximate the function tlx by a sequence function h n G £ 2 (T, f 2 d9). So Vt £ K 

7(r?) > lim D(/i„) > t / r ? (^)^. 

rw+oo 

Letting t to infinity, we get I(rj) = +oo. 
5.3 Proof of corollary 2.5 

Here we assume /' G L 2 (T, d6»), so ^ |^| 2 |^fc(/)| 2 < °o- 

k 

We thus only need to prove that for all h G L P '(T, d0) (so/iG L 2 (T, d6>) since p' > 2) 



h(9)E2 n (9)d9 - / f(9)h(9)d9 



We have 



h(9)El n (9)d9 - / f(9)h(9)d9 

JT 



E M)w)-E^(mC') 



E V ffe(/)ffe(/l) " ^ 

|fc|<ra-l |fc|>n 



We have E l^fcWI < E — \h(f)\\h(h)\- So applying Cauchy-Schwartz in- 

|fc|>n |fc|>ra 

equality we get 



j^h{9)m n {9)d9 - p(9)h(9)d9 <i /El fc l 2 l^(/)l' /El^WI 5 



C 

< — . 



The proof ends. 



5.4 Proof of Theorem 3.1 

For simplicity, we only consider the problem in R and F(xq, ...,xi) = F(xo). 

Let us describe briefly how the preceding proof of Theorem 2.1 can be easily extended to 

the more general framework of our example. 
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Since F' is Lipschitz continuous, we get for some positive L, and for all ./V 
\F(X»)\ < L(l + |Xf | 2 ) < 2L(N + l)(l+ E 



so that, setting <5' = n r , . r , . y 

' ° 2L(N+1) 2 supj a-j 

validity of the LSI, we get 



where 6 is given in 1)2. 2|) . by the assumption on the 



< oo. 



Since Chen (Sj deals with moderate deviations of m— dependent Banach space valued 
random variables, so that the first step is exactly the same in the general case. 

To prove the asymptotic negligibility as N — > oo of S n (F) — S^(F) with respect to the 
MDP, we need to assume the boundedness of the density. We apply again 1)5.;-})) to 



k=l 

We have 

iez \k=i / 

I n \ 2 / n N 

< 2^ E(^-Ww +2E E^(W)-W) 



vfc=l 



T n {{g-g"y)F'{X. 



+ 2 



T n ((^)2)(F'(X)-F'(X Ar )) 



By the fact that the derivative of F is Lipschitz and the spectral density is bounded, we 
have that the last term is bounded by 

2L\\g - g N \\l(n + <X,X» + 2||^|| 2 <X Ar - X.,X N - X). 
Finally by (|4.2|) . as A 2 — ||g — g^ll 2 ^, can be chosen arbitrary small for large n, 



\ logE ( e W n (S n (F)-s n (F»))\ < LCA 2 ||5 _ g 



b 2 



JV||2 
I oo 



?1 



^io g | : iciir 2 A 2 ^||i/- / y 



JV||2 



n 

46!" 



n 

-2\2°n ii JV||2 



loo Mi/ MOO 



log 1-4CXA"A^ <?-<? 



AT i|2 



and the left hand side of this last inequality is easily seen to behave as n — > oo as 

||< 7 -^|| 2 (LCA 2 + 2C7LK 2 A 2 || 5 || 2 ). 
By the famous Fejer Theorem, under the assumption of continuity of g, we get that 

lim \\g - g N \\l Q = 0, 

iV^oo 



20 



which yields to the desired negligibility. 

A careful reading of Step 3 in the proof of Theorem 2.1 shows that the extension to the 
general case brings no further difficulties. The proof then ends. 

Remark 5.1. To prove negligibility of Step 2 in general framework, we only have to 
establish this negligibility for each of the coordinates Fj of F (as there is only a finite 
number of coordinates) , and also that 

m / n \ ^ 

i vg i 2 = EEkE^--^w)-% w ,--X)) 

i£Z j=l V k=l J 

o 

m / I n \ 

= ££ I ££ ( a i~k- s dx s Fj(X k ,- ■ -,X k+ i) - af_ k _ s d Xs F j (X k w , ■ ■ -,X^ +l )) J 

ieZ j=l \s=Q k=l / 

I m / n ~* 

< (' + *)££££ (a t „ k _ s d Xs F 3 (X k , ■ ■ -,X k+l ) - a?_ k _ s d Xs Fj(X», ■ ■ , X* +l )) 

s=0 3=1 ieZ \k=l / 

which leads to the same estimation as before as d Xa Fj is supposed to be Lipschitz for each 
j and s. 
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